Personally I would get DH to find a different job in the meantime that pays the bills at least and then move when the time is right for all of you..

I couldn't do it and would do the above..